Validation of average error rate over classifiers
نویسندگان
چکیده
منابع مشابه
Validation of average error rate over classifiers
We examine methods to estimate the average and variance of test error rates over a set of classi ers We begin with the process of drawing a classi er at random for each example Given validation data the average test error rate can be estimated as if validating a single classi er Given the test example inputs the variance can be computed exactly Next we consider the process of drawing a classi e...
متن کاملAverage-rate optimal PSAM transmissions over time-selective fading channels
Enabling linear minimum-mean square error (LMMSE) based estimation of random time-selective channels, Pilot Symbol Assisted Modulation (PSAM) has well documented merits as a fading countermeasure capable of improving bit error rate performance. In this paper, we establish average-rate optimality of PSAM by showing that the insertion of equi-powered and equi-spaced pilot symbols in PSAM transmis...
متن کاملError Messages Are Classifiers
This paper presents a lightweight process to guide error report authoring. We take the perspective that error reports are really classifiers of program information. They should therefore be subjected to the same measures as other classifiers (e.g., precision and recall). We formalize this perspective as a process for assessing error reports, describe our application of this process to an actual...
متن کاملGeneralization Error of Combined Classifiers
We derive an upper bound on the generalization error of classi ers which can be represented as thresholded convex combinations of thresholded convex combinations of functions. Such classi ers include single hidden-layer threshold networks and voted combinations of decision trees (such as those produced by boosting algorithms). The derived bound depends on the proportion of training examples wit...
متن کاملGeneralization Error of Invariant Classifiers
This paper studies the generalization error of invariant classifiers. In particular, we consider the common scenario where the classification task is invariant to certain transformations of the input, and that the classifier is constructed (or learned) to be invariant to these transformations. Our approach relies on factoring the input space into a product of a base space and a set of transform...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 1998
ISSN: 0167-8655
DOI: 10.1016/s0167-8655(97)00160-8